Systems and methods for visualizing and analyzing cardiac arrhythmias using 2-D planar projection and partially unfolded surface mapping processes

ABSTRACT

A method for projecting a 3D surface geometry onto a planar projection comprises: obtaining a 3D geometry of a chamber surface using an algorithm that generates angles and distances between points on the chamber surface that represent mapping information; applying a cutting curve to at least two points on the chamber surface; and at least partially unfolding at least a portion of the chamber surface along the cutting curve to form a planar projection that optimally preserves the angles and distances between points on the chamber surface.

BACKGROUND

a. Field of the Invention

The present disclosure relates generally to image generation in medicaldevice mapping systems. More particularly, the present disclosurerelates to generation of two-dimensional images from three-dimensionalmodels.

b. Background Art

Current intracardiac navigational and mapping systems use athree-dimensional (3D) data representation in which a 3D geometric modelof the endocardium is drawn on a computer display. Typical systemsinvolve the use of one or more catheters to simultaneously map the heartwhile measuring voltages therein. The 3D geometric model is generatedusing data obtained by one or more electrodes on the catheters. While 3Dgeometric models allow viewing cardiac surfaces and various diagnosticmaps at any angle by rotating them on a computer screen, the user doesnot see the whole cardiac surface at any time. In addition, in somesituations the user cannot see the full picture of the catheter withrespect to the cardiac surface geometry because there are backgroundelements of the cardiac surface geometry that are obstructed bygraphical elements of the cardiac surface geometry in the foreground.

In displaying 3D geometric models, such as 3D cardiac models of theheart, on a two-dimensional (2D) display, it is often difficult to seethe entire diagnostic map (e.g. voltage map) at the same time. Thus, the3D geometric model must be rotated in order to see different areas ofthe model. Furthermore, if the diagnostic map has animated graphics, theuser may not be able to see the entirety of the graphics simultaneouslybecause the animation will be running on the whole model (background andforeground) when the model is rotated. As the result, certain diagnosticmap features and patterns might be difficult to identify using only a 3Dgeometric model of the heart.

Recent advancements in mapping technology have involved unfolding of 3Dimages into two-dimensional maps. For example, U.S. Pat. No. 7,542,595to Moreau-Gobard describes unfolding of a 3D heart image using aray-casting technique in order to more fully visualize coronaries andvessels on the surface of the heart. However, unfolding by such atechnique produces significant distortion of the heart, rendering theresulting 2D image difficult to decipher.

BRIEF SUMMARY

The present disclosure is directed to systems and methods for projectinga 3D surface geometry onto a planar projection. In one embodiment, amethod is for rendering a 2D planar representation from a 3D surfacegeometry of a chamber, the method comprising: obtaining a 3D surfacegeometry of a chamber; identifying a first surface section on the 3Dsurface geometry having a first feature of the chamber; selecting firstand second points on the 3D surface geometry to form a cutting curve;and unfolding the 3D surface geometry at the cutting curve to render a2D planar representation of the chamber; wherein the first and secondpoints are selected to optimize representation of the first feature inthe 2D planar representation.

In another embodiment, a method is for projecting a 3D surface geometryonto a planar projection, the method comprising: obtaining a 3D geometryof a chamber surface using an algorithm that generates angles anddistances between points on the chamber surface that represent mappinginformation; applying a cutting curve to at least two points on thechamber surface; and at least partially unfolding at least a portion ofthe chamber surface along the cutting curve to form a planar projectionthat optimally preserves the angles and distances between points on thechamber surface.

In yet another embodiment, a method is for projecting a 3D surfacegeometry onto a planar projection, the method comprising: obtaining a 3Dgeometry of a chamber surface, the 3D geometry including mappinginformation, the mapping information comprising an area of interest andan area of disinterest; applying a cutting curve to at least two pointson the chamber surface; and at least partially unfolding at least aportion of the chamber surface along the cutting curve to form a planarprojection, wherein the planar projection minimizes distortion to thearea of interest without regard to distortion of the area ofdisinterest.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagrammatic depiction of an exemplary intracardiac mappingand navigation system.

FIGS. 2A-2D are schematic diagrams of exemplary dipole pairs of drivenbody patch electrodes suitable for use with the intracardiac mapping andnavigation system of FIG. 1.

FIG. 3 is a display screen of the intracardiac mapping and navigationsystem of FIG. 1, showing a planar image of a three dimensional model ofa heat.

FIG. 4 is a perspective view of a heart schematically showing a catheterplaced in a heart chamber.

FIG. 5 is a schematic view of a modeled hull shape of the heart of FIG.4

FIG. 6 is a schematic view of a re-meshed hull shape of the modeled hullshape of FIG. 5.

FIG. 7A is a schematic diagram showing the generation of atwo-dimensional projection of a three-dimensional model of a heart fordisplaying as a planar image on a display panel.

FIG. 7B is a schematic top view of the diagram of FIG. 7A showing thepresentation of the two-dimensional projection and the three-dimensionalmodel as planar images on a display panel.

FIG. 8 is a view showing a three-dimensional drawing of a cardiac modelof the left atrium of the heart as obtained, for example, with thesystem of FIG. 1.

FIG. 9 is a view showing a planar projection of the heart chamber inFIG. 8, including the display of catheter electrodes and an interpolatedvoltage map.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1 is a diagrammatic depiction of an embodiment of exemplary mappingand navigation system 10. With reference to FIGS. 1-9, like numeralsindicate the same or similar elements in the various views. System 10may include various visualization, mapping and navigation components asknown in the art, including, for example, an EnSite™ Velocity™ systemcommercially available from St. Jude Medical, Inc., or as seengenerally, for example, by reference to U.S. Pat. No. 7,263,397, or U.S.Publication No. 2007/0060833, both of which are hereby incorporated byreference in their entireties as though fully set forth herein. Withreference to the present disclosure, system 10 is configured to, amongother things, collect cardiologic data, particularly electrocardiograminformation, for a three-dimensional (3D) model of a heart, and todisplay such data in a user-friendly, two-dimensional (2D) format.Presenting 3D electrocardiogram information in an easy to understand 2Dformat facilitates identification of potential areas of interest forperforming medical procedures, making diagnoses and the like. Forexample, users of system 10, such as clinicians, doctors, orcardiologists, may be able to more readily identify an ablation targetfor remedying a cardiac arrhythmia.

System 10 may include an electronic control unit (ECU) 12,analog-to-digital converter (A-to-D) 14, low-pass filter (L.P.) 16,switch 18, signal generator 20, and a plurality of body surface patchelectrodes 22. System 10 may be electronically and/or mechanicallycoupled with an elongate medical device, such as, in one embodiment, acontact or non-contact mapping catheter (e.g., cardiac mapping catheter24). Catheter 24 includes distal end portion 26 and proximal end portion28. Distal end portion 26 includes electrode 32 and extends into heart36 of patient 38. Proximal end portion 28 connects catheter 24 to switch18.

System 10 may be configured to provide, among other things, mapping ofpatient tissue, such as one or more chambers of heart 36 of patient 38,and a 3D model bearing the surface geometry of the mapped tissue.Accordingly, ECU 12 may be configured to receive electrical measurementsfrom one or more electrodes (diagrammatically shown as a singleelectrode 32 in FIG. 1) on mapping catheter 24 and, based on thosemeasurements, to assess one or more electrical characteristics of tissuesurrounding the distal end of mapping catheter 24. In an embodiment, ECU12 may be configured to determine a voltage distribution of anendocardial surface according to electrical measurements from mappingcatheter electrode 32. ECU 12 may be further configured to determinethat voltage distribution with respect to an anatomical model, such as amodel of one or more chambers, features, and/or surfaces of heart 36.

ECU 12 may include non-volatile memory 40 and processor 42 configured toperform many of the functions and operations described herein—i.e.,memory 40 may store instructions for performing portions of one or moremethods or processes described herein, and processor 42 may beconfigured to execute those instructions to perform the methods orprocesses. Memory 40 may also be configured to store an anatomicalmodel, such as a cardiac chamber model, a plurality of measurements frommapping catheter 24, a plurality of terms and values for the methodsdescribed below, and other data and information. In an embodiment, ECU12 may additionally or alternatively comprise a field-programmable gatearray (FPGA) and/or other known computing device. In some embodiments,and as discussed further below, ECU 12 may be configured to perform amethod of computing a 2D projection and/or a partially unfolded surfaceof a 3D model in order to better facilitate visualization of the modeland features of the model.

In addition to (and as a part of) electrophysiology mapping, system 10may be configured to determine the position and orientation (P&O) ofmapping catheter 24 (e.g., of distal end portion 26) within patient 38.Accordingly, ECU 12 may be configured to control generation of one ormore electrical fields and determine the position of one or moreelectrodes (e.g., electrode 32) within those fields. ECU 12 may thus beconfigured to control signal generator 20 in accordance withpredetermined strategies to selectively energize various pairs (dipoles)of body surface patch electrodes 22, as described in greater detailbelow. In operation, ECU 12 may (1) obtain raw patch data (i.e., voltagereadings) via filter 16 and A-to-D converter 14 and (2) use the rawpatch data (in conjunction with electrode measurements) to determine theraw, uncompensated, electrode location coordinates of electrode 32positioned inside heart 36 or a chamber thereof in three-dimensionalspace. ECU 12 may be further configured to perform one or morecompensation and adjustment functions, and to output a location ofelectrode 32. Motion compensation may include, for example, compensationfor respiration-induced patient body movement, as described in U.S.Publication No. 2012/0172702, which is hereby incorporated by referencein its entirety for all purposes.

Body surface patch electrodes 22 may be used to generate axes-specificelectric fields within patient 38, and more specifically within heart36. Three sets of patch electrodes may be provided: (1) electrodes 22X1,22X2, (X-axis); (2) electrodes 22Y1, 22Y2, (Y-axis); and (3) electrodes22Z1, 22Z2, (Z-axis). Additionally, a body surface electrode (“bellypatch”) 22B, may be provided as an electrical reference. Other surfaceelectrode configurations and combinations are suitable for use with thepresent disclosure, including fewer electrodes 22, more electrodes 22,or different physical arrangements, e.g. a linear arrangement instead ofan orthogonal arrangement.

Each patch electrode 22 may be independently coupled to switch 18, andpairs of patch electrodes 22 may be selected by software running on ECU12 to couple patch electrodes 22 to signal generator 20. A pair ofelectrodes, for example the Z-axis electrodes 22Z1, 22Z2, may be excitedby signal generator 20 to generate an electrical field in patient 38 ofthe patient and, more particularly, within heart 36. In one embodiment,this electrode excitation process occurs rapidly and sequentially asdifferent sets of patch electrodes 22 are selected and one or more ofthe unexcited surface electrodes 22 are used to measure voltages. Duringthe delivery of the excitation signal (e.g., current pulse), theremaining (unexcited) patch electrodes 22 may be referenced to bellypatch 22B and the voltages impressed on these remaining electrodes 22may be measured. In this fashion, patch electrodes 22 may be dividedinto driven and non-driven electrode sets. Low pass filter 16 mayprocess the voltage measurements. The filtered voltage measurements maybe transformed to digital data by analog to digital converter 14 andtransmitted to ECU 12 for storage (e.g. in memory 40) under thedirection of software. This collection of voltage measurements may bereferred to herein as the “patch data.” The software may have access toeach individual voltage measurement made at each surface electrode 22during each excitation of each pair of surface electrodes 22.

The patch data may be used, along with measurements made at electrode32, to determine a relative location of electrode 32. The patch data mayalso be used along with measurements made at electrode 32 and/or otherelectrodes on catheter 24, such as a tip electrode, or on another deviceto determine a relative location of electrode 32 and/or the otherelectrodes. The discussion above and below describes determining thelocation of electrode 32, but it should be understood to apply to a tipelectrode and other electrodes, as well. In some embodiments, potentialsacross each of the six orthogonal patch electrodes 22 may be acquiredfor all samples except when a particular surface electrode pair isdriven. In embodiments, sampling a voltage with a particular patchelectrode 22 while a surface electrode 22 acts as a source or sink in adriven pair may be avoided, as the potential measured at a drivenelectrode during this time may be skewed by the electrode impedance andthe effects of high local current density. In an alternate embodiment,however, sampling may occur at all patch electrodes 22, even those beingdriven.

Generally, in an embodiment, three nominally orthogonal electric fieldsmay be generated by a series of driven and sensed electric dipoles inorder to determine the location of catheter 24 (i.e., of electrode 32).Alternately, these orthogonal fields can be decomposed and any pair ofsurface electrodes (e.g., non-orthogonal) may be driven as dipoles toprovide effective electrode triangulation.

FIGS. 2A-2D show a plurality of exemplary non-orthogonal dipoles,designated D0, D1, D2 and D3. In FIGS. 2A-2D, the X-axis surfaceelectrodes are designated XA and XB, the Y-axis surface electrodes aredesignated YA and YB, and the Z-axis electrodes are designated ZA andZB. For any desired axis, the potentials measured across anintra-cardiac electrode 32 resulting from a predetermined set of drive(source-sink) configurations may be combined algebraically to yield thesame effective potential as would be obtained by simply driving auniform current along the orthogonal axes. Any two of patch electrodes22 may be selected as a dipole source and drain, as noted above, withrespect to a ground reference, e.g., belly patch 22B, while theunexcited body patch electrodes 22 measure voltage with respect to theground reference. Electrode 32 placed in heart 36 is also exposed to thefield from a current pulse, and voltages on electrode 32 areindividually and separately measured with respect to ground, e.g., bellypatch 22B.

Referring again to FIG. 1, data sets from each of patch electrodes 22and electrode 32 are all used to determine the location of electrode 32within heart 36. After the voltage measurements are made for aparticular set of driven patch electrodes 22, a different pair of patchelectrodes 22 may be excited by signal generator 20 and the voltagemeasurement process of the remaining patch electrodes 22 and electrode32 takes place. The sequence may occur rapidly, e.g., on the order ofone hundred times per second in an embodiment. To a first approximationthe voltage on electrode 32 within heart 36 bears a linear relationshipwith position between patch electrodes 22 that establish the fieldwithin heart 36, as more fully described in U.S. Pat. No. 7,263,397referred to above.

Some or all of the conventional twelve (12) ECG leads, coupled toadditional body patches and designated collectively by reference numeral44, may be provided to support the acquisition of an electrocardiogram(ECG) of the patient. As shown, ECG leads 44 may be coupled directly tothe ECU 12 for acquisition and subsequent processing to obtain the phaseof the heart in the cardiac cycle. Cardiac phase information may beused, in an embodiment, in mapping of electrical activity of heart 36,as described below.

In summary, FIG. 1 shows an exemplary system 10 that employs seven bodypatch electrodes 22, which may be used for injecting current and sensingresultant voltages. Current may be driven between two patches 22 at anytime. Measurements may be performed between non-driven patch 22 and, forexample, belly patch 22B as a ground reference. A patch bio-impedance,also referred to as a “patch impedance”, may be computed according tothe following equation:

${{{BioZ}\left\lbrack n\rightarrow m \right\rbrack}\lbrack k\rbrack} = \frac{V_{k}}{I_{n\rightarrow m}}$

where V_(k) is the voltage measured on patch k and I_(n→m) is a knownconstant current driven between patches n and m. The position ofelectrode 32 may be determined by driving current between different setsof patches and measuring one or more patch impedances. In oneembodiment, time division multiplexing may be used to drive and measureall quantities of interest. Position determining procedures aredescribed in more detail in, for example, U.S. Pat. No. 7,263,397 andU.S. Publication No. 2007/0060833 referred to above. To perform anelectrophysiology (e.g., mapping) procedure, distal end portion 26 ofcatheter 24 or multiple such catheters 24 may be manually guided to adesired location by a user such as a physician.

In addition to determining the positions of electrode 32, system 10 mayalso be configured to assess the electrical activity of the heart.Accordingly, ECU 12 may be further configured to perform one or moresteps in one or more methods of determining a voltage distribution on acardiac surface.

As briefly mentioned above, ECU 12 is configured to generate athree-dimensional (3D) surface geometry or 3D model of heart 36. The 3Dmodel can be displayed as a planar image on a display connected to ECU12. Furthermore, ECU 12 includes hardware and software for furtherprocessing the 3D model, such as for converting the 3D model into atwo-dimensional (2D) projection or planar representation of the 3D modelthat can be displayed as a flat image in conjunction with, oralternatively to, the 3D model on the display. In some embodiments, the2D projection can be used to determine features and patterns that wouldotherwise be difficult to visualize with only a 3D model.

FIG. 3 shows an exemplary computer display 46 that can be connected toECU 12 of FIG. 1. Display 46 is used to show data to a physician or userof system 10, and to present certain options that allow the user totailor system configuration for a particular use. It should be notedthat the contents on the display can be easily modified and the specificdata presented is illustrative and not limiting of the invention. Imagepanel 48 shows 3D model 50 of a heart chamber, which defines surfacegeometry 51. Surface geometry 51 of 3D model 50 is simultaneouslydisplayed as 2D projection 52 in image panel 48. However, either of 3Dmodel 50 or 2D projection 52 may be displayed individually. In FIG. 3,3D model 50 is shown as a left atrium, but may comprise any heartchamber such as a ventricle. Additionally, system 10 may be used to mapother chambers or hulls of patient 38 (FIG. 1) that can be displayed onimage panel 48 as a 3D model.

3D model 50 includes “isochrones” in false color (shown in grayscale inFIG. 3) with guide bar 54, which are likewise shown as wave fronts 56 on2D projection 52 in the same false color indicated by guide bar 54. Inthe image of FIG. 3, 3D model 50 has been generated using a catheter,such as catheter 24 (FIG. 1), to create a chamber representation that isdisplayed as a modeled hull shape (See FIG. 6). Display 46 also showselectrical activity of heart 36 (FIG. 1), such as the voltagesassociated with wave fronts 56. The electrical activity can also beshown as ECG information 58. The particulars of 3D model 50 (e.g.rotation, size, etc.), 2D projection 52 (e.g. cutting curve,orientation, etc.) and ECG information 56 (electrograms, QRS, etc.) canbe specified and/or changed at user panel 60.

In an embodiment, one or more of the steps of the methods describedbelow (e.g. with reference to FIGS. 4-7B) may be performed by ECU 12(e.g., embodied in software stored in the memory 40 and executed byprocessor 42) to generate 3D model 50 and 2D projection 52. To addressthe issue of identifying features and patterns that might be useful inassessing, for example, ablation targets, an exemplary method includes,in addition to obtaining or generating the 3D model, the computation ofa whole chamber map on a 2D planar image of a structure (e.g., theendocardial surface of a heart chamber) and/or an “unfolding” of the 3Dchamber model that can be visualized all at once. Such maps could beuseful, for example, as an aid in identifying certain global featuresand patterns of electrical excitations of the heart.

FIGS. 4 and 5 illustrate the generation of a 3D model, such as 3D model50, from heart 36. FIG. 6 illustrates a re-meshing of a 3D model fromFIG. 5 that is used to generate a 2D projection, such as 2D projection52. FIGS. 7A and 7B illustrate the generation of planar images ofsurface geometry 51 for 3D model 50 and 2D projection 52 of heart 36.FIGS. 8 and 9 show screen shots of a plurality of catheters insertedinto a 3D model of a left atrium, and a 2D projection of the left atriumand the catheters, respectively.

Generally, a method of rendering a 2D planar representation from a 3Dsurface geometry of a chamber comprises generating 3D model 50,selecting points on surface geometry 51 of 3D model 50 to form a cuttingcurve, and unfolding surface geometry 51 at the cutting curve to rendera 2D planar representation of the chamber. Thus, “unfolding” a 3D modelconceptually comprises making an incision in the hollow hull that formsthe 3D model and stretching the hull at the incision so that the edge ofthe incision forms the edge of a 2D projection or planar representation.As mentioned, the 3D model can be re-meshed to minimize distortion ofthe entire 2D planar representation. Furthermore, the cutting curve canbe positioned on the 3D model to minimize distortion of particularfeatures of interest on the surface geometry in the 2D planarrepresentation. In an embodiment, the 3D model can be partially, insteadof fully, unfolded to show only the particular features of interest.

FIG. 4 is a perspective view of heart 36 schematically showing catheter24 placed inside of left atrium 61 and left ventricle 62. Catheter 24may be a conventional EP catheter, as described above with reference toFIGS. 1 and 2. Catheter 24 includes electrodes, such as tip electrode32T and ring electrode 32R. While electrodes 32T and 32R lie on asurface of a chamber within heart 36 and when signal generator 20(FIG. 1) is “off”, each electrode can be used to measure the voltage onthe heart surface. The magnitude of this voltage as well as its timingrelationship of the signal with respect to the heartbeat events aremeasured and presented to the user through display 46 (FIG. 3). The peakto peak voltage measured at a particular location on the heart wallshows areas of diminished conductivity and may reflect an infractedregion of the heart. The timing relationship data are typicallydisplayed as “isochrones” on display 46. In essence, regions thatreceive the depolarization waveform at the same time are shown in thesame false color or gray scale. Since electrodes 32T and 32R lie withinheart 36, the location process described above can be used to detecttheir location inside of left atrium 61 and/or left ventricle 62. Thedetected locations are collected as a set of points that is used togenerate 3D model 50, which maps the surface geometry 51, or topologicalfeatures, of heart 36.

FIG. 5 is a schematic view of modeled hull shape 70 of heart 36 of FIG.4. Modeled hull shape 70 comprises points 72 and panels 74. Modeled hullshape 70 represents the cloud of points 72 collected from catheter 24 inFIG. 4 to form left atrium 61. Modeled hull shape 70 forms a hollow bodythat represents connections between the most exterior of points 72 inthe data set. Usually the hull is composed of triangular panels 74having a semi-regular form. Points 72 can be resampled to increase thenumber of points for further computation. The resampling processinterpolates between vertices on the exterior of the polygon. Inessence, intermediate points are defined within each facet of the hullor polyhedron as represented by a data point. Although the resamplingprocess creates “fictitious” interpolated points within an enhanced dataset, these points are useful in the modeling operation. Modeled hullshape 70 may comprise a completed model that can be shown on display 46as 3D model 50. The method of FIG. 5 generally shows the generation ofalpha shapes for modeling convex hulls, as is described in more detailin U.S. Pat. No. 8,253,725, which is incorporated herein by reference.

Other methods for gathering data points and generating curves thatrepresent 3D model 50 can be used. For example, smooth curves can be fitto the enhanced set of data points generated by the resampling process.Conventional smoothing algorithms are used corresponding to a leastsquares fit. This process yields a mathematically differentiable surfacethat is easily visualized and manipulated. Such smoothing processes aredescribed in greater detail in U.S. Pat. No. 7,263,397 referred toabove. Other methods for generating 3D models include the use of convexhull shapes, as are known in the art. For any method of generating 3Dmodel 50, a surface geometry is shown on display 46 that allows a userof system 10 to visualize chambers of heart 36, such as left atrium 61and left ventricle 62.

In the present disclosure, the collection of data forming a 3D model,such as points 72 and panels 74 forming 3D model 50, can be furtherprocessed to generate a 2D projection. There are various ways in which a2D projection could be computed. In some embodiments, a center orprojection can be placed somewhere inside a surface of the 3D modelusing, for example, a variant of spherical coordinates. To obtain theplanar representation of the chamber, one can drop the radius from thespherical coordinates and retain only the angles. In some embodiments,the planar projections could be supplemented by proper annotations (asdiscussed in greater detail below with reference to FIG. 9), which couldinclude anatomical features and catheter electrodes in the proximity ofthe surface, among other things. In some embodiments, the diagnosticmaps (e.g. electrocardiogram information) pertaining to the surface canbe drawn on the planar projection or an unfolded 3D view of the chamber.

Recent advances in computational geometry and processing speed permit amore sophisticated cutaway view, unfolding a general surface model ontosomething more hemispherical but still recognizable as that chamber, andminimizing distortions of angle and area. In particular, 3D model 50 canbe re-meshed into a collection of points and surfaces more readilytransformed into a 2D image that minimizes distortion of the features ofthe 3D model in a flattened picture, enabling a user to make moremeaningful interpretations of the data. The ability to visualize anunfolded view of the entire endocardial surface at once, without using aclipping plane as was previously needed, is desirable to, among otherthings, preserve the ability of a user of system 10 to interpret data onthe 2D image.

FIG. 6 is a schematic view of re-meshed hull shape 76 of modeled hullshape 70 of FIG. 5. Re-meshed hull shape 76 includes points 78 andpanels 80. Points 78 and panels 80 are laid out in a manner that isreadily adapted to “unfolding” 3D model 50 into a 2D planarrepresentation. Possible algorithms for generating re-meshed hull shape76 and a resulting 2D planar representation include Least SquaresConformal Mapping (which has a Matlab toolbox). Additionally, theadaptive resampling re-meshing algorithm from Semechko, et al. (“HighQuality Remeshing of Closed Genus-0 Surfaces,” Medical Image Computingand Computer Assisted Intervention 2011, Toronto, Calif., 2011) and theparameterization re-meshing algorithm of Alliez, et al. (“InteractiveGeometry Remeshing,” ACM SIGGRAPH 21, 347-354, 2002), both of which areincorporated herein by reference in their entirety for all purposes, maybe used improve the 2D projectability, or unfoldability, of a 3D hull.Re-meshed hull shape 76 optimally preserves angles, distances, areas andthe like of 3D model 50 when unfolded as 2D projection 52. Optimallypreserving 3D model 50 is a tradeoff between preserving angles anddistances, and the embodiments described herein make appropriatetradeoffs to give a user of system 10 visually pleasing, accurate imagesthat are useful in performing medical procedures and diagnostics. In oneembodiment that uses a re-meshing algorithm, such as that of Alliez, etal., the re-meshed surfaces comprise equilateral or nearly equilateraltriangles that increase the resolution of the 3D model withoutdistorting the basic image represented when projected as a 2D planarrepresentation.

FIG. 7A is a schematic diagram showing the generation of two-dimensional(2D) projection 52 of three-dimensional (3D) model 50, which representsleft atrium 61 of heart 36 (FIG. 4). FIG. 7B is a schematic top view ofthe diagram of FIG. 7A showing the presentation of 2D projection 52 and3D model 50 as planar images on image panel 48. FIGS. 7A and 7B arediscussed concurrently.

3D model 50 and 2D projection 52 are viewable on image panel 48 ofdisplay 46 (FIG. 3) as planar images. 3D model 50 comprises a smoothedsurface, such as modeled hull shape 70 of FIG. 5, having a particularsurface geometry 51. In FIGS. 7A and 7B, 3D model 50 is shown withoutgridlines for clarity. 3D model 50 includes first surface section 82Aand second surface section 82B, which include first feature 84A andsecond feature 84B, respectively. Cutting curve 86 extends along thesurface of 3D model 50 and passes through points 88A, 88B, 88C and 88D.

3D model 50 represents the exterior surface hull of left atrium 61 ofFIG. 4, for example. 3D model 50 includes a generally smooth lowerportion and a curved upper portion. The lower smooth portion includesareas of interest to a user of system 10, such as a cardiologist. Forexample, first surface section 82A and second surface section 82B mayinclude myocardium that has weak or malfunctioning electrical activity,with features 84A and 84B representing specific local electricalactivity, such as rotors. The curved upper portion includes areas ofhigh curvature, such as pulmonary veins 90A and 90B.

As is illustrated in FIGS. 7A and 7B, only one of surface sections 82Aand 82B can be seen at a time on 3D model 50 from image panel 48. Thus,it becomes necessary for a user of system 10 to rotate 3D model 50between two or more positions, such as by using user panel 60 on display46 (FIG. 3), to see the complete electrical pattern between sections 82Aand 82B. In order to more readily visualize surface sections 82A and82B, 3D model 50 is unfolded into 2D projection 52 (not drawn to scalein FIGS. 7A and 7B) so that surface sections 82A and 82B can besimultaneously viewed on image panel 48. In particular, 2D projection 52can comprise a complete unfolding of surface geometry 51 such that theentirety of 3D model 50 is shown. In other embodiments, 2D projection 52can comprise a partial unfolding of 3D model 50 such that only sections82A and 82B are shown and areas related to veins 90A and 90B areomitted.

In order to unfold 3D model 50, the collection of data pointsrepresenting the model are re-meshed into a higher resolution collectionof data points. For example, the data representing points 72 and panels74 (FIG. 5) is converted into data representing points 78 and panels 80(FIG. 6). In one embodiment, re-meshed hull shape 76 may be displayed as3D model 50. Next, cutting curve 86 is positioned on surface geometry 51to initiate the “unfolding.” Cutting curve 86 can be positioned anywhereon surface geometry 51. However, the position of cutting curve 86 can beselected to minimize distortion to sections 82A and 82B. To that end,cutting curve 86 can be positioned away from sections 82A, near areaswhere distortion is tolerable in the 2D planar representation.Furthermore, the distortion of sections 82A and 82B can be minimized byplacing cutting curve 86 near an area of surface geometry that willinherently result in distortion, such as an area of high curvature likeveins 90A and 90B. Additionally, distortion of sections 82A and 82B canbe minimized by sizing the total length of cutting curve 86 to begreater than the dimensions of sections 82A and 82B. Furthermore,cutting curve 86 can include multiple points and segments in order tobetter position cutting curve 86 on surface geometry 51. For example,rather than have cutting curve 86 extend linearly between points 88A and88D, intermediary points 88B and 88C can be added to guide cutting curve86 along a desired route on surface geometry 51. Although, in someembodiments, cutting curve 86 may comprise a straight line. In yet otherembodiments, cutting curve 86 may comprise a closed curve, wherein endsof the curve meet to form an area that is removed from the 3D modelbefore being stretched into the 2D planar representation.

System 10 can be configured to automatically select the shape andposition of cutting curve 86 to minimize distortion. A user of system 10may specify areas of interest and areas of disinterest on 3D model 50.For example, sections 82A and 82B can be highlighted or identified on 3Dmodel 50 as being areas of interest, while pulmonary veins 90A and 90Bcan be highlighted or identified as being areas of disinterest. In oneembodiment, a user of system 10 may draw on image panel 48 of display 46(FIG. 3) to identify various areas of 3D model 50. Based on theseinputs, ECU 12 (FIG. 1) can place cutting curve 86 on surface geometryto maximize preservation of features 84A and 84B upon unfolding. Forexample, the placement, overall length and the number of segments ofcutting curve 86 can be automatically determined by system 10.Alternatively, cutting curve 86 can be manually drawn on 3D model 50 atimage panel 48.

System 10 can also be configured to automatically regenerate 2Dprojection 52 at appropriate times. For example, a user of system 10 maydetermine that a different area of interest on 3D model 50 is to beviewed and analyzed for a different procedure or purpose. Thus, surfacesections 82A and 82B may no longer be areas of interest and it is nolonger desirable to minimize the distortion of 2D projection 52 atsurface sections 82A and 82B. The user may rotate 3D model 50 as shownin display panel 48 such that a different 2D planar image is shown and adifferent area of interest can be highlighted. ECU 12 can thusrecalculate the parameters for cutting curve 86 in order to minimize thedistortion to the newly selected area of interest in the 2D planarrepresentation of image panel 48.

Once 3D model 50 has been unfolded into 2D projection 52, image panel 48can be augmented with various features to facilitate mapping, diagnosis,treatment and the like, as discussed with reference to FIGS. 8 and 9.

FIG. 8 is a view showing a three dimensional drawing of cardiac model 92of a left atrium, as obtained with an intracardial navigational system,such as system 10 of FIG. 1. FIG. 9 is a view showing planar projection94 of the heart chamber in FIG. 8. FIG. 8 shows catheters 96A-96H, eachhaving a group of electrodes that are shown in FIG. 9 as dots.

FIG. 9 also shows an interpolated voltage map, which may be obtainedwith catheters 96A-96H, superimposed over planar projection 94. Thevoltage map depicts wave fronts of the electrical excitation, whichcould be useful in the visual identification of potential atrialfibrillation (AF) drivers such as rotors, foci, etc. In someembodiments, the magnitude of the voltages can be displayed as differentcolors (e.g., different pixel colors) on image panel 48. Color-codingfor the interpolated voltages is shown on guide bar 98. In someembodiments, the interpolated voltage between the electrodes can becomputed using a Thin Plate Splines method. Other techniques forinterpreting the voltages can also be employed.

FIG. 8 shows catheters 96A-96H arranged generally horizontally (withreference to the orientation of FIG. 8) so that the electrodes arearranged three-dimensionally in a cylindrical pattern against theinterior walls of the left atrium. As such, it may be difficult todiscern which electrodes are in the foreground and which are in thebackground. FIG. 9 shows the electrodes for catheters 96A-96H unfoldedinto a two-dimensional planar pattern. Thus, the entire electricalactivity of the left atrium in conjunction with the location of all ofthe electrodes can be clearly seen in one view.

In addition to identifying each of the electrodes with an identifier andshowing guide bar 98, the image displayed on image panel 48 along withthe 2D planar projection can include other annotations that, among otherthings, provide a viewer of image panel 48 with orientation of the heartchamber. For example, the names of features of cardiac model 92 can beshown, such as left lateral wall, septum, mitral valve, etc. Tapemeasures and/or grid coordinates on the planar or partially unfoldedsurfaces can also be used to show the corresponding distance values fromthe original surface. Additionally, diagnostic information may berecorded on the 2D planar projection and recorded for later viewing.

In some embodiments, a planar map (e.g. a 2D model such as that shown inFIG. 9, FIG. 3, or FIGS. 7A and 7B having superimposeddiagnostic/electrical data) can be used to detect one or more potentialablation sites and/or to visually confirm the results of variousdiagnostic algorithms pointing to potential ablation target sites. The2D planar projection provides a simultaneous view of the heart geometryalong with the associated electrical activity while preserving, as bestas possible, the angles and distances between points on the surface. Assuch, complete performance of the heart chamber is intuitivelypresented.

The 2D planar projection can be used to render any of a number ofdifferent types of diagnostic maps on the planar projections orpartially unfolded surfaces. Animated planar maps can also be generatedand shown in real-time to aid in the diagnosis and treatment ofarrhythmias. For example, real-time electrical activity can besuperimposed on the 2D planar projection. As discussed above, in someembodiments, a 3D model can be rotated or tilted to allow a better viewof a particular area on the surface geometry. In order to facilitatereal-time viewing and regeneration of the 2D planar projection, ECU 12can be configured to provide indicator 100 that gives a user of system10 a level of feedback regarding the distortion level of the presented2D planar projection. Indicator 100 may comprise any suitable indicator,such as a dial, an analogue indicator or a digital indicator. Thedistortion level may be determined, for example, by comparing a data setfrom the 2D planar projection to a data set from the original 3D modelor a data set from a reference or idealized 2D planar projection. Inother embodiments, an indicator can be provided directly on the surfaceof the 2D planar projection itself. For example, a square or trianglegrid could be provided on the 2D planar projection to indicate areas ofdistortion. In another embodiment, the transparency of the 2D planarprojection could be varied to indicate different levels of distortion,e.g., areas of high distortion could be highly transparent with areas oflow distortion being more opaque.

Various embodiments are described herein to various apparatuses,systems, and/or methods. Numerous specific details are set forth toprovide a thorough understanding of the overall structure, function,manufacture, and use of the embodiments as described in thespecification and illustrated in the accompanying drawings. It will beunderstood by those skilled in the art, however, that the embodimentsmay be practiced without such specific details. In other instances,well-known operations, components, and elements have not been describedin detail so as not to obscure the embodiments described in thespecification. Those of ordinary skill in the art will understand thatthe embodiments described and illustrated herein are non-limitingexamples, and thus it can be appreciated that the specific structuraland functional details disclosed herein may be representative and do notnecessarily limit the scope of the embodiments.

Although a number of embodiments have been described above with acertain degree of particularity, those skilled in the art could makenumerous alterations to the disclosed embodiments without departing fromthe sprit or scope of this disclosure. For example, all joinderreferences (e.g., attached, coupled, connected, and the like) are to beconstrued broadly and may include intermediate members between aconnection of elements and relative movement between elements. As such,joinder references do not necessarily infer that two elements aredirectly connected and in fixed relation to each other. It is intendedthat all matter contained in the above description or shown in theaccompanying drawings shall be interpreted as illustrative only and notlimiting. Changes in detail or structure may be made without departingfrom the spirit of the invention as defined in the appended claims.

Any patent, publication, or other disclosure material, in whole or inpart, that is said to be incorporated by referenced herein isincorporated herein only to the extent that the incorporated materialsdoes not conflict with existing definitions, statements, or otherdisclosure material set forth in this disclosure. As such, and to theextent necessary, the disclosure as explicitly set forth hereinsupersedes any conflicting material incorporated herein by reference.

Reference throughout the specification to “various embodiments,” “someembodiments,” “one embodiment,” or “an embodiment,” or the like, meansthat a particular feature, structure, or characteristic described inconnection with the embodiment is included in at least one embodiment.Thus, appearances of the phrases “in various embodiments,” “in someembodiments,” “in one embodiment,” or “in an embodiment,” or the like,in places throughout the specification are not necessarily all referringto the same embodiment. Furthermore, the particular features,structures, or characteristics may be combined in any suitable manner inone or more embodiments. Thus, the particular features, structures, orcharacteristics illustrated or described in connection with oneembodiment may be combined, in whole or in part, with the featuresstructures, or characteristics of one or more other embodiments withoutlimitation given that such combination is not illogical ornon-functional.

1. A method of rendering a 2D planar representation from a 3D surfacegeometry of a chamber, the method comprising: obtaining a 3D surfacegeometry of a chamber; identifying a first surface section on the 3Dsurface geometry having a first feature of the chamber; selecting firstand second points on the 3D surface geometry to form a cutting curve;and unfolding the 3D surface geometry at the cutting curve to render a2D planar representation of the chamber; wherein the first and secondpoints are selected to optimize representation of the first feature inthe 2D planar representation; and displaying the 2D planarrepresentation as a planar image on a display unit.
 2. The method ofclaim 1, wherein the first and second points are positioned on the 3Dsurface geometry to minimize distortion of the first feature afterunfolding.
 3. The method of claim 2, wherein the cutting curve ispositioned away from the first surface section.
 4. The method of claim1, wherein the first and second points are positioned on the 3D surfacegeometry to selectively ignore distortion to portions of the chamberafter unfolding.
 5. The method of claim 4, wherein the cutting curve ispositioned in proximity to areas of high curvature of the 3D surfacegeometry.
 6. The method of claim 1, wherein the cutting curve has alength greater than that of the first surface section.
 7. The method ofclaim 1, wherein a plurality of cutting curves are formed to unfold the3D surface geometry.
 8. The method of claim 1, wherein the first andsecond points are automatically selected to determine an optimal cuttingcurve that minimizes distortion of the first feature.
 9. The method ofclaim 1, wherein the 3D surface geometry is re-meshed such thatrendering of the 2D planar representation optimally preserves angles anddistances of the 3D surface geometry after unfolding.
 10. The method ofclaim 1, further comprising generating a conformal map from the 3Dsurface geometry, wherein the first and second points are selected onthe conformal map.
 11. The method of claim 10, further comprisingadaptively resampling the conformal map before selecting the first andsecond points.
 12. (canceled)
 13. The method of claim 1, furthercomprising simultaneously displaying the 3D surface geometry with the 2Dplanar representation in the planar image.
 14. The method of claim 1,further comprising: adjusting an orientation of the 3D surface geometryin space; identifying a second surface section having a second featureof the chamber on the 3D surface geometry; forming a new cutting curvethat will optimally preserve representation of the second feature afterunfolding; unfolding the 3D surface geometry at the new cutting curve torender a new 2D planar image; and displaying the second surface sectionand the second feature as the planar image.
 15. The method of claim 1,wherein the 2D planar representation is annotated in the planar imagewith a name of the first feature.
 16. The method of claim 1, furthercomprising providing feedback on the planar image of a distortion levelof the first surface section between the 2D planar representation andthe 3D surface geometry.
 17. The method of claim 1, wherein: the chamberis an atrium or ventricle of a heart; and further comprising displayingvoltages of the heart on the planar image.
 18. The method of claim 1,further comprising: identifying a second surface section having a secondfeature of the chamber on the 3D surface geometry, the second surfacesection being located on a portion of the 3D surface geometry with anobstructed view of the first surface section; selecting the first andsecond points to optimally preserve representation of the first andsecond features; and unfolding the 3D surface geometry to simultaneouslyview the first surface section and the second surface section.
 19. Amethod for projecting a 3D surface geometry onto a planar projection,the method comprising: obtaining a 3D geometry of a chamber surfaceusing an algorithm that generates angles and distances between points onthe chamber surface that represent mapping information; a cutting curveto at least two points on the chamber surface; and at least partiallyunfolding at least a portion of the chamber surface along the cuttingcurve to form a planar projection that optimally preserves the anglesand distances between points on the chamber surface.
 20. The method ofclaim 19, further comprising re-meshing the 3D geometry into a uniformor regularized mesh.
 21. The method of claim 20, further comprisinggenerating a conformal map from the 3D geometry before applying thecutting curve.
 22. The method of claim 21, further comprising generatinga distortion field from the conformal map before applying the cuttingcurve.
 23. The method of claim 19, wherein the at least two points arepositioned on the 3D geometry to minimize distortion of an area ofinterest of the mapping information after unfolding.
 24. The method ofclaim 23, further comprising: re-forming the cutting curve to optimallypreserve representation of a new area of interest after unfolding; andunfolding the chamber surface along the new cutting curve to form a newplanar projection.
 25. The method of claim 19, wherein a plurality ofcutting curves are selected to unfold the 3D geometry.
 26. The method ofclaim 19, wherein the cutting curve is automatically selected todetermine an optimal cutting curve that minimizes distortion of themapping information.
 27. The method of claim 19, wherein the planarprojection is annotated with descriptors of mapping information.
 28. Themethod of claim 19, further comprising providing feedback of adistortion level of the mapping information between the planarprojection and the 3D geometry.
 29. The method of claim 19, wherein thechamber surface is an atrium or ventricle of a heart.
 30. The method ofclaim 29, further comprising displaying voltages of the heart on theplanar projection.
 31. The method of claim 19, further comprising:identifying first and second features on the chamber surface;positioning the cutting curve to optimally preserve representation ofthe first and second features; and at least partially unfolding at leasta portion of the chamber surface along the cutting curve to form aplanar projection that simultaneously shows the first and secondfeatures.
 32. The method of claim 19, further comprising simultaneouslydisplaying the 3D geometry and the planar representation of the chambersurface in an output image.
 33. A method for projecting a 3D surfacegeometry onto a planar projection, the method comprising: obtaining a 3Dgeometry of a chamber surface, the 3D geometry including mappinginformation, the mapping information comprising: an area of interest;and an area of disinterest; applying a cutting curve to at least twopoints on the chamber surface; and at least partially unfolding at leasta portion of the chamber surface along the cutting curve to form aplanar projection, wherein the planar projection minimizes distortion tothe area of interest without regard to distortion of the area ofdisinterest.